APPARATUS, METHOD AND SYSTEM FOR IMAGE 
PROCESSING WITH A COLOR CORRECTION DEVICE 



This application is based on Japanese Patent 
Application No. 241251/1999 filed on August 27, 1999, the 
contents of which are incorporated herein by reference, 

PACKGROUNP OF THE INVENTION 

1. Field of the Invention 

The present invention relates to an apparatus, a 
method and a system for image processing with a color 
correction device for outputting an image by a printer or a 
display. 

2. Description of the prior art 

In a printer or a copying machine, a calibration 
function is realized for a diagnosis and a correction of an 
operating state, so that quality deterioration of an image due to 
a change of environment or a degradation of components is 
prevented. In a digital print apparatus, a calibration is 
performed for adjusting a degree of an image processing such 
as a density correction. In a color print apparatus, a 
calibration is performed for diagnose a color reproduction state. 
In the calibration, a test image is printed and the print result is 
read by a scanner for comparing the read data with reference 
data. In this case, a user usually sets the print result to the 
scanner. 

Usually, the calibration is set to be executed 
automatically every time when a power is turned on. In 
another example, it is executed when the predetermined number 
of days has passed since the previous execution (see U.S. 
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Patent No. 5,889,929). In still another example, the user can 
select an execution time from a plurality of execution times 
(see U.S. Patent No. 5,950,036). 

Since the calibration requires a lot of time, it is 
desirable to execute the calibration only when it is necessary. 
Especially, when printing a test image, frequent calibrations 
may increase a burden of the user. 

SUMMARY OF THE INVENTION 
The object of the present invention is to reduce the 
number of times of the automatic execution of the calibration 
and to make full use of the performance of the image output 
apparatus. 

' " An imag~e p"r6cessin"g~apparatus a'ccording to the 

present invention comprises a converter for converting the 
received image data into image data of a standard color space, 
a decision portion for deciding whether the image data 
converted by the converter are within the reference range of the 
color reproduction in the output device, and a controller for 
controlling the output device to perform a calibration of 
making the color reproduction range of the output device close 
to the reference range when the decision portion has decided 
that the image data are out of the reference range. 

An image processing method according to the present 
invention comprises the steps of receiving the image data, 
converting the received image data into image data of a 
standard color space, deciding whether the image data 
converted in the converting step are within the reference range 
of the color reproduction in the output device, and controlling 
the output device to perform a calibration of making the color 



reproduction range of the output device close to the reference 
range when the image data have been decided to be out of the 
reference range in the deciding step. 

An image processing system according to the present 
5 invention comprises a r correction portion for performing r 
correction of the received image data, an output device for 
reproducing the image data corrected by the r correction 
portion, a converter for converting the received image data into 
image data of a standard color space, a decision portion for 
10 deciding vs^hether the image data converted by the converter are 
within the reference range of the color reproduction in the 
output device, and a controller for calibrating the 
characteristics of the T correction portion so as to make the 



lil ~ color reproduction range of the output device close to the 

15 reference range when the decision portion has decided that the 
image data are out of the reference range, wherein the r 

y correction portion corrects the image data by the calibrated 

ni characteristics, and the output device reproduces the corrected 

P| image data. 

20 

BRIEF DESCRIPTION OF THE DRAWINGS 
Fig. 1 is a block diagram showing a general 
configuration of an image output system according to the 
present invention. 
25 Fig. 2 is a block diagram of a color space conversion 

portion. 

Fig. 3 is a block diagram of a reproduction range 
decision portion. 

Figs. 4A and 4B show a concept of a color 
30 reproduction range. 
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Fig. 5 is a block diagram of a T correction portion. 

Fig. 6 shows contents of a 7 table. 

Fig. 7 is a block diagram of an image processing 

portion . 

Fig. 8 shows an example of a warning display. 
Fig. 9 is a flow chart of the calibration operation of 
the color correction device. 



DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Hereinafter, the present invention will be explained 
more in detail with reference to embodiments and drawings. 

Fig. 1 is a block diagram showing a general 
configuration of an image output system 1 according to the 
prese~rit^ in v~en~tion. The image output system 1 comprises a 
scanner 10 for reading an original by decomposing it into three 
colors, i.e., a red, a green and a blue, a print engine 20 for 
printing a color image, a color correction device 100 that 
realizes the calibration, and a computer 200 for generating a 
print job. More specifically, the image output system 1 is a 
color printer and an image reader, or a computer system having 
a combination machine thereof. The color correction device 
100 built in the color printer or the image reader. Otherwise, 
as an independent apparatus, it is connected by a cable for use. 

In the color correction device 100, an input interface 
103 is input switching means that send data from the scanner 10 
or the computer 200 as input image data Dl to the rear part. 
An image processing portion 104 processes the input image data 
Dl and converts them into CMYK data D2 that are suitable for 
subtractive color. A 7 correction portion 105 is a circuit 
that sets a r characteristics for each of the C, M, Y and K 



colors in accordance with the characteristics of the print engine 
20. The r -corrected CMYK data D3 are sent to the print 
engine 20 as an object to be printed via a selector 106. 

The input image data Dl are also sent to a color space 
5 conversion portion 110 from the input interface 103 so as to 
determine whether the calibration is necessary or not. The 
color space conversion portion 110 converts the input image 
data Dl that are RGB data into image data Dls of a standard 
color space (such as a color space of a CIELAB color system). 
10 A reproduction range decision portion 111 decides whether the 
image data Dls are within a reference range of the color 
reproduction by the print engine 20 or not, i.e., whether a color 
that cannot be reproduced is not included. If the image data 
- - - Dls are data" out of thTe r^fererice"range, responding to an input 
l-t 15 of a signal SJ indicating it, a CPU 109 requests a display 

portion 112 for a message display that asks whether the 
calibration is necessary or not. The display portion 112 
includes a display with a touch panel, for example, so as to 
display a predetermined message and operation buttons. The 
20 CPU 109 is supplied with a signal SC that indicates operation 
contents from the display portion 112. 

When a user instructs the execution of the calibration, 
a test pattern generation portion 107 outputs predetermined test 
image data DT. The selector 106 sends the test image data DT 
25 to the print engine 20. The user sets a piece of paper on 

which a test image is printed on a table of the scanner 10. The 
read data Dt of the test image are stored in an image memory 
108 via the input interface 103. The CPU 109 reads the read 
data Dt from the image memory 108 and compares them with a 
30 target value of the test image, so as to determine a variation 
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quantity of the color reproduction characteristics. Then, the 
CPU 109 selects a T correction table in accordance with the 
determined variation quantity and sets the selected r 
correction table in the r correction portion 105. 
5 By performing this process of the CMYK data D2 in 

the r correction portion 105 after the calibration, the color 
reproduction performance of the print engine 20 can be used 
adequately. The input interface 103 or the image processing 
portion 104 may memorize the input image data Dl or the 

10 CMYK data D2. Otherwise, the image data may be given again 
from the computer 200. 

Fig. 2 is a block diagram of the color space 
conversion portion that is included in the whole configuration 

- - sho wn in FigT 1. " 

15 The input image data Dl are converted into the XYZ 

color system data by a first operation circuit llOA, and then 
are converted into L*a*b* color system image data Dls by a 
second operation circuit llOB. These conversions are 
performed by a 3 x 3 matrix operation, for example. Letters 

20 mjj and n^- (i, j = 1-3) denote conversion coefficients that are 
unique to the scanner 10. It is also possible to convert the 
RGB data into the L*a*b* data by one operation. 

Fig. 3 is a block diagram of the reproduction range 
decision portion. 

25 Chromaticness indexes a* and b* of the image data 

Dls that are supplied from the color space conversion portion 
110 are given to sixteen look-up tables (LUT) 310|-310i6 in 
parallel. Each of the look-up tables 310i-310i6 outputs a 
signal for each pixel. The signal indicates a decision of 

30 whether the input value that is a combination of the 
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chromaticness indexes a* and b* is within the reference range 
or not (e.g., "0" means within the reference range, and "1" 
means out of the reference range). Each of the look-up tables 
310i-310i6 stores a table for the decision about a subspace that 
5 is generated by dividing the L*a*b* color space into sixteen in 
the direction of the L* axis. Therefore, the selector 321 
selects one output that corresponds to the value of the lightness 
index L* from the outputs of the sixteen look-up tables 310i- 
310i6- The selector 321 is supplied with the lightness index 
10 L* as a select signal that was converted from eight bits into 
four bits by a bit conversion portion 320. 
b|| A counter 322 counts the number of the pixels whose 

colors are out of the reference range in accordance with the 
~ ^ oufpilt of~the selector 32 1. Then, the comparator 323 outputs 

M 15 a signal SJ that indicates that the input image is out of the 

^ reference range when the output value of the counter 322 

5^ becomes greater than a predetermined value REF. The 

]¥ predetermined value REF is given by the CPU 109. 

lit 

□ Figs. 4A and 4B show a concept of the color 

20 reproduction range. 

Fig. 4A shows a three-dimensional space defined by 
the L* axis, the a* axis and the b* axis, in which the color 
reproduction ranges (the reference range and the real range) RS, 
R are solids having a small circle at the ends in the direction of 

25 the L* axis (substantially spheres in Fig. 4A). Fig. 4B shows 
the color reproduction range in two-dimensional space defined 
by the a* axis and the b* axis, in which the L*a*b* color space 
is divided in accordance with plural levels of the lightness 
index L*. It is supposed that the lightness index L* is divided 

30 into sixteen, and the levels 1, 2, ... 16 are set in order from low 
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lightness. Therefore, the color reproduction range in which 
L* = 1 is a small circle. In Fig. 4B, color reproduction ranges 
in which L* = 1, L* = 5 and L* = 10 are drawn. In this 
example, the real color reproduction range R,o in which L* = 
10 is substantially narrower than the reference range RS. 

Fig. 5 is a block diagram of the T correction portion. 

The r correction portion 105 comprises four look-up 
tables 501-504 that correspond to four colors, C, M, Y and K, 
respectively. Each of the look-up tables 501-504 can be 
switched in the input and output relations. As explained 
above, the CPU 109 sets the optimal j table in accordance 
with the print state of the test image. The table may be 
rewritten, or one of plural tables may be selected for use. 

Fig". 6~ shows' c~bnfenfs of the r table. 

In the calibration, if the read vale of the test image is 
smaller than the target value, the current table (e.g., the 
standard table 0) is replaced with the table +n whose r 
characteristics are steep. If the read vale of the test image is 
larger than the target value, the table -m whose T 
characteristics are not steep. In this example shown in Fig. 6, 
there are three kinds of 7 characteristics including the 
standard and the plus side of the standard and the minus side of 
the standard. However, the optimal one is selected from many 
tables having different gradients in reality. 

Fig. 7 is a block diagram of the image processing 

portion. 

The contents of the image processing are not related 
to the present invention directly, so the general configuration 
will be explained. 

The input image data Dl are converted from intensity 
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data to density data DR, DG and DB for each of the R, G and B 
colors by the LOG conversion portion 401. In a masking 
operation portion 402, density data DR, DG and DB are 
converted into color data of C, M and Y adapted to the scanner 
characteristics and the print engine characteristics. Then, a 
UCR/BP portion 403 performs a black print generating process, 
in which the C, M and Y equivalent portions are replaced with 
K data. 

An area decision portion 405 performs an area 
decision process such as an edge decision in accordance with 
input image data Dl. An MTF correction portion 404 performs 
a process such as an edge emphasis of the CMYK data in 
accordance with the result of the area decision, so as to output 
CM YK data D2 whose image' quality is improved. 

Fig. 8 shows an example of a warning display. 

If the input image data Dl are out of the reference 
range, a message Zl indicating the fact is displayed. At the 
same time, a message Z2 asking whether the calibration is 
necessary is displayed along with two buttons Z5, Z6. When 
the user pushes the button Z5 (Yes), the calibration starts. 
When the button Z6 (No) is pushed, the warning display is 
aborted, and the input image data Dl are printed under the 
current operation condition. 

Fig. 9 is a flow chart of the calibration operation of 
the color correction device. 

If the input image data are out of the reference range 
of the color reproduction, a display indicating the fact to the 
user is performed (#11, #12). Then, when the user instructs 
the execution, the calibration is performed. Namely, the test 
image is printed, the print result is read by the scanner so as to 



obtain the read data, and the contents of the r correction are 
changed in accordance with the difference between the print 
result and the target value (#13-#18). 

If the input image data are within the reference range 
5 of the color reproduction, or when the user instructs non- 
execution of the calibration even if the input image data are out 
of the reference range, the calibration is not executed, but the 
CMYK data D3 are outputted in accordance with the input 
image data. 

10 According to the above-mentioned example, the 

^ calibration is executed not regularly but limitedly when it is 

'€} regarded to be necessary from the input image. Therefore, the 

IJi 

J; burden of the user, i.e., placing a piece of paper having a 

— - printed test pattern on The scanner TO can be eliminated. 

15 According to the present invention, the number of 

s times of automatic execution of the calibration can be reduced, 

Q 

m and the performance of the image output apparatus can be used 

i5J adequately. 

y In addition, the user can stop the calibration in 

20 accordance with the state so that the output of the image does 
not delayed. 

While the presently preferred embodiments of the 
present invention have been shown and des cribed, it will be 
understood that the present invention is not limited thereto, and 
25 that various changes and modifications may be made by those 
skilled in the art without departing from the scope of the 
invention as set forth in the appended claims. 
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